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1. INTRODUCTION 


The barrage of information pertaining to software being developed on a project 
can be overwhelming. Current status information as well as the statistics and 
history of software releases should be "at the fingertips" of project management 
and key technical personnel. This paper discusses the development, 
configuration, capabilities, and operation of a relational database, the System 
Engineering Database ( SEDB ) which was designed to assist management in monitoring 
of the tasks performed by the Network Control Center (NCC) Project. This 
database has proved to be an invaluable project tool and is utilized daily to 
support all project personnel. 

1 . 0 DEVELOPMENT METHODOLOGY 

The development of the SEDB utilizes a spiral methodology, whereby capabilities 
are prototyped, implemented and testing concurrently. Each capability provided 
by the SEDB is "prototyped a little, implemented a little, tested a little, 
prototyped a little more, implemented a little more, and tested a little more". 
Throughout development the primary users of each capability are significantly 
involved by utilizing the prototype and providing comments. This reiterative 
methodology prevents the full implementation of a capability that is not useful 
or appropriate for the users. The use of such a methodology has been shown to 
be significantly efficient and effective for all types of software development. 

The initial SEDB development was to provide a tracking mechanism for impact 
assessments. Its original purpose was merely to provide a database in which 
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these impact assessments would be logged. As this capability was being 
prototyped. Quality Assurance (QA) was in need of a better problem reporting 
database. The impact assessment capability was therefore modified and prototyped 
again to include the problem report capability. This initial development 
determined the methodology for all future database efforts. Project personnel 
determine a need and work closely with the database developers in ensuring its 
correct implementation. 

2 . 0 CONFIGURATION 

The SEDB is capable of supporting a project in a standalone mode or in a LAN 
configuration. A standalone configuration only allows one user at a time access 
to the database. The requirements for a standalone configuration are as follows: 

o 486DX33 PC 
o 8 MB RAM 
o 200 MD HD 
o Laser Printer 
o DOS 5 

o RBase Version 4.0 

To allow multiple users simultaneous access to the database, a LAN configuration 
is required. The NCCDS Project utilizes the following LAN configuration: 

Workstation: 486DX33 

8 MB RAM 
200 MD HD 
EtherNet Card 
Fileserver: 486DX 33 

8 MB RAM 
500 MB HD 
EtherNet Card 

Laser Printer 

The software requirements are as follows: 

DOS 5 

Novel Netware 
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RBase Version 4.0 

The LAN components (10 base - twisted pair) are as follows: 

HUB 

Patch Panel 
Telco Block 
Level 4 Wiring 

The SEDB can be run with a copy of RBase Runtime (this is available at no cost 
from the author), thereby eliminating the need to purchase RBase 4.0. RBase 
Runtime, however, does not allow software modifications on the PEDB. 

3.0 SYSTEM ENGINEERING DATABASE SEGMENTS 

The SEDB is comprised of four major Segments: the Project Engineering Database 

(PEDB) , the Configuration Management Database (CMDB) , the Requirements Database 
(RQDB ) , and the Hardware Resources Database (HWDB ) . This section specifically 
describes each of these segments and the benefits each segment provides to the 
project . 

3.1 Project Engineering Database ( PEDB) 

The PEDB segment is the most heavily utilized segment of the database. It 
manages all project problem reporting data such as System Trouble Reports (STRs), 
System Problem Reports (SPRs), and Integration System Problem Reports (ISPRs). 
In addition, the PEDB also is used to manage all other potential project impacts, 
such as NCC Requirements Inputs (NRIs), Minispecif ications , and future impacts. 
The PEDB also provides the user with the capability to submit /review SEDB 
database problem reports. The PEDB al2ows project management to retrieve this 
data for: 

o History information (e.g., How long did it take Development personnel 
to turnaround fixes to problems found during System Testing for a 
particular release two years ago? What was the Development turnaround 
time for a release six months ago?) 

o Current status of a particular problem/impact ent ity/release (how many 
ISPRs have been closed currently in Integration Testing?) 
o Planning purposes (e.g., how many DSI does a future release contain 
if we include the resolution to these STRs?) 
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The PEDB offers four significant benefits to a project. One major benefit is 
that it allows searching of problem reports and impact entities by any data 
field. This allows the database user to find what ha/she needs using any 
information available. For example, a problem report can be searched by number, 
a text string, system functionality, responsible organization, problem type, 
priority, status, and/or system configuration. 

Secondly, the PEDB automates the preparation of reports which can be displayed 
and/or printed. These reports can be created by the database user utilizing the 
search capability to generate the information desired or by utilizing the 
standard reports currently existing on the PEDB. One example of a standard 
report that is of significant importance to a project is the weekly release 
status report (see Figure 1) which is automatically generated using the PEDB. 
This report provides detailed information about the status of all problems for 
a particular release. 

A third major benefit of the PEDB is that it provides current, consistent 
statistical data. Since all the project data is kept on one database, all 
project personnel have access to the same data and the assurance that the data 
is the most current. 

Finally, the PEDB provides a historical archive for analysis. All data for 
previous releases can be accessed through the PEDB. This historical data can be 
utilized to provide release history information and defect causal analysis data 
(e.g., the number of problems written against each subsystem, the average length 
of time required to resolve each problem, the number of problem reports by 
problem type, etc.). 

3.2 Configuration Management Database (CMDB) 

The prime responsibility of the CMDB segment is to track software through the 
development process, that is, to manage CM information. The CMDB segment was 
created to replace manual CM logs. CM personnel enter data into the CMDB 
directly from internal software delivery forms received from Development 
personnel. This allows the CMDB to generate and identify delivery contents for 
a specific build and/or release for a specific time period (see Figures 2 and 3). 
In addition, the CMDB allows the monitoring of CM level status for all units. 
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Figure 1* Example of a weekly release status report generated by the Project Engineering 
Database (PEDB) . 


Date : 05/28/93 

List of XXX units delivered for RELEASE 93.1 


Unit Name 


Type 

Action 

APPGBL.MMS 


K 

C 

BELLTA 


5 

d 

BELLTARA 


C 

a 

CALTSYN 


S 

C 

CCCFERP 


B 

C 

CCCFERP1 


B 

C 

CCCFERP2 


B 

C 

CCCINIT 


B 

c 

CCCISBU 


B 

c 

CCCISCT 


B 

c 

CCCISRP 


E 

C 

CCCISRP1 


S 

c 

CCCISRP2 


S 

c 

CCCISUB 


S 

c 

CCCISYN 


S 

c 

CCCISYN1 


S 

c 

CCCLSPS2 


S 

A 

CCCNORQ 


S 

c 

CCCPTUD 


S 

c 

CCCRAPP 


s 

c 

CCCRAPS 


s 

c 

CCCRASD 


5 

c 

CCCRASW 


S 

A 

CCCRPRE 


s 

A 

CMCCDY 


s 

C 

CMCDYN 


5 

C 

CMCICS 


s 

C 

CMCNCS 


s 

C 

CMCRAP 


5 

c 

CMCSDP 


S 

A 

of data for XXX 

(where 

XXX = Segment) 


Type = S(ource) 

, T(emplate - STS), P( roc - 

SPS) , 

Q(LP Report 

- STS) 

, H (Schema/Subschema 

- SPS), 

R (unstream 

- S PS i 

or ITS, (Mapstream - 

SPS) , 


I(nclude File - CCS, NFE, ITS), D(ata File - CCS, ITS), 
C ( ommand Procedure - CCS), M(MS Description File - CCS, 
or O(ther) 

Action = A(dd), C(hange), or D{elete) 

Page : l 

Figure 2. Example of a Configuration Management Database ICMDB) report listing 
units delivered for a release. 
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SDF STATUS REPORT 

This report lists fixes installed in the SDP for RELEASE 93.1 
since the start of System Test. 


Report Date : 

5/28/93 


CCS - Current 

Diskpack : 

9 3_i 

ITS - current 

ID : 

93.1 

EPS - Current 

Onlines : 

NCC*NCC. ONLINE 
NCC*NCC. SPS 

NFE - current 

ID : 

93.1 


[ REQUIREMENT 

DATE DELIVERED 

SEGMENT 

LEVEL J 

| 

J 6CR 71 

2/9/93 

CCS 

r 

N/A J 

J SPR 92-12-01-303 

2/9/93 

CCS 

N/A J 

j SPR 92-12-09-312 

2/3/93 

CCS 

2 ! 

JSPR 92-12-21-331 

2/11/93 

CCS 

2 ! 

[SPR 93-01-22-013 

4/5/93 

CCS 

2 ! 

j SPR 93-01-25-022 

2/11/93 

CCS 

2 j 

j SPR 93-02-02-040 

3/28/93 

CCS 

2 ! 

JSPR 93-02-02-041 

3/28/93 

CCS 

2 \ 

JSPR 93-03-16-114 

4/9/93 

CCS 

2 ! 

JSPR 93-03-17-119 

4/1/93 

CCS 

2 \ 

JSPR 93-04-13-164 

4/13/93 

CCS 

2 ! 

JSPR 93-04-26-0186 

4/28/93 

CCS 

N/A | 

JSPR23 

5/31/93 

CCS 

2 \ 
i 

j MINI SPEC IT032 

1/15/93 

ITS 

i 

2 \ 

JSPR 92-12-10-318 

2/25/93 

ITS 

2 \ 

JSPR 92-12-31-336 

1/15/93 

ITS 

2 ! 

JSPR 93-01-18-010 

1/29/93 

ITS 

2 \ 

JSPR 93-02-19-069 

4/7/93 

ITS 

2 ! 

JSPR 93-03-15-110 

3/25/93 

ITS 

2 ! 

i 

J93.0QF1 MERGER 

4/23/93 

SPS 

i 

2 \ 

jRunstreams 

12/14/92 

SPS 

N/A j 


* - New item within the last week 

If you have any questions regarding this report, please 

contact processor's names- in processor's locations- or at phone 

numbers- . 


Figure 3. Example of a Configuration Management Database (CMDB) report listing the 
status of problem resdutions installed in the Software Development 
Facility (SDF) . 
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i.e., it verifies that the appropriate units are propagated to specific testing 
levels . 

The CMDB provides three major benefits to the project. One significant 
contribution is that the CMDB provides QA with a Software Engineering Notebook 
(SEN) verification tool. QA can utilize the CMDB to ensure that Development SENs 
are accurate by comparing such information as delivery dates, frequency of unit 
deliveries, and type of unit changes. 

A second contribution of the CMDB is that it provides CM with a much need 
internal organizational tool. It eliminates all costs associated with 
maintaining manual logs. In addition, the CMDB maintains easily accessible CM 
historical information for analysis purposes. 

Finally, the CMDB provides an online reporting capability for CM. Specifically, 
CM personnel can automatically generate reports for (1) units delivered for a 
specific build/release, (2) deliveries processed at any point in time, and (3) 
elapsed time between when CM personnel received a delivery and when it was 
processed. 

3.3 Requirements Database (RQDB) 

The RQDB segment manages the text of the NCCDS Detailed Requirements Document 
( 530-DRD-NCCDS ) . Specifically, the RQDB provides on-line accessibility to the 
requirements to all project personnel. The RQDB offers browse and search 
capabilities, thereby allowing project personnel to find on-line a requirement ( s ) 
text by paragraph number and/or a text search. The RQDB allows only approved 
personnel to update the database with approved Document Change Notices (DCNs) and 
Revisions. All project personnel, however, have the capability to enter comments 
on each requirement. These comments are saved as attachments and are normally 
used to provide information on software versus operational requirements, and/or 
impact assessments performed on a specific requirement. 

The RQDB also manages the relationship of the system software and test cases to 
requirements. Specifically, all system Computer Software Configuration Items 
(CSCIs), units, modules and executables are mapped to individual requirements. 
The lines of code associated with each software unit are also maintained in the 
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RQDB. The capability to perform an online search for units is available to 
users. As a system security measure, users are allowed to download this software 
data but are prevented from uploading data. In support of system testing, the 
RQDB provides a mechanism to map a test case to each requirement, thereby 
allowing the automatic generation of test and implementation matrices {see Figure 
4). 

The RQDB provides four significant benefits to the project. The first benefit 
is the result of the requirements being automatically updated by downloading the 
requirements document file(s) into the database. This capability ensures 
complete accuracy of the requirements. 

Second, the RQDB allows project personnel to perform string searches to identify 
associated requirements to the specific requirement being examined. This 
capability allows individuals to qurckly find all requirement references to a 
specific item. 

A third major benefit is the capability to automatically create implementation 
and test matrix reports. This feature provides reports that list each 
requirement, the associated CSCI , the test case and type, and the implementation 
date. This information is updatable for each release and allows efficient 
generation of reports for various requirements and design reviews. 


Finally, the RQDB provides the capability to access online Delivered Source 
Instruction (DSI) counts. Each requirement is mapped to its associated DSI . 
This capability allows personnel to quickly determine the impact of implementing 
or changing a requirement. 

3.4 Hardware Resource Monitoring Database (HWDBJ 

The most recently developed segment of the SEDB is the Hardware Resource 
Monitoring Database (HWDB). This segment was developed to provide for entry of 
data related to hardware resource usage time. As the NCC utilizes two 
development facilities [the Software Development Facility (SDF) and the 
Development Test and Training Facility (DT&T)], each with several types of 
equipment, the HWDB provides comprehensive resource utilization data for a 
specific time period (e.g., weekly, monthly). This data provides the time 
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Figure 4. Example of the NCCDS implementation report generated by the Requirements Database (RQDB) . 


requested by the user, time allocated, and time actually used. In addition, the 
HWDB maintains lost time data and provides the capability to enter lost time 
reason codes by day and by hardware resource type. Based on the above 
information, the HWDB provides management a tool to review or automatically 
generate reports via several options including, but not limited tot 
organization, facility, time period, requestor, release, and lost time summary 
(see Figure 5). 

The primary benefit provided by the HWDB is that the maintenance of hardware 
usage data provides a history of resource utilization. This information is 
useful for determining how many resource hours are being lost and the reasons for 
the lost time. In addition, resource utilization metrics are useful for 
projecting future resource needs for similar releases. 

4.0 OPERATIONAL USAGE OF SEDB 

The SEDB may be utilized by all project personnel. Figure 6 illustrates an 
overview of SEDB usage. Specif ically , the following provides the normal 
utilization of the SEDB for each project group: 

o QA - enter/update SPR and STR data 

compare delivery contents generated from 
the CMD3 to Development SENs (validation 
tool ) 

o CM - enter/update software baseline data 

verify appropriate units propagated to 
specific testing levels 
report CM data 

o Test - enter test case data for requirements 
- generate test status information 
o Development - review SPR and STR status 

review impact assessment 
information 

o Maintenance - review SPR and STR status 

review impact assessment 
information 
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RELEASE: <ALL> NCC/DTS.T H/W RESOURCE As of 09/02/93 

ORGANIZATION: <ALL> FOR WEEK BEGINNING 


W 

x 

© 

o 


n z 

© HH 

© ~ 
w w 

CO W 

o J 
D 

o 

1*3 

O 

w 



E- 

1 

© 

© 

© 

© 

© 

o 

o 

1 

© 

i 

o 








< 

1 








1 


t 








u 


1 








1 


i 








u 

x 

1 

© 

o 

o 

o 

O 

o 

© 

1 

© 

i 

© 







2 

H 

1 








I 


i 








w 

H 

1 

1 

1 

o 

© 

o 

o 

© 

© 

© 

1 

1 

1 

O 

i 

i 

i 

o 








a 

1 

1 








1 

1 


i 

i 









H 

1 

1 

o 

© 

© 

o 

© 

© 

o 

1 

1 

© 

i 

t 

in 








< 

1 








1 


1 

© 







x 


1 

1 








1 

1 


i 

i 




TJ 

QJ 




u 

a 

1 

o 

o 

© 

© 

© 

o 

© 

1 

o 

i 

in 



N 




o 

H 

1 








1 


i 

© 



•H 






1 








1 


i 




rH 






1 








1 


l 




•H 






1 

o 

o 

o 

© 

© 

© 

o 

1 

o 

i 




QJ hJ 

E © 





<x 

1 

1 








\ 

1 


i 

i 

© 



•H 0) 

H > to 






1 








1 


i 




M E 






1 








1 


i 




T5 C -h 





H 

i 

eg 

rg 

© 


^r 

© 

© 

1 

rg 

i 

o 



4) 0 H 

4J a; 

« K — ! 





< 

1 

rH 

eg 

eg 

rH 

r-i 



1 

© 

i 

rH 








1 








1 


i 

eg 







w 


1 








1 


i 




3 <L) 3 




H 

cs 

1 

eg 

© 

© 



© 

o 

1 

o 

i 

© 



C E h 




2 

H 

1 

1 


eg 

eg 

H 

r-i 



1 

1 

CO 

i 

i 

o 

rg 



Hi H U 

a H < 






I 








1 


i 




11 U 11 






I 


© 

© 

© 

© 

© 

o 

l 

© 

i 









K 

1 

I 

1 

rH 

eg 

eg 

eg 

rg 



1 

1 

1 

rH 

rH 

i 

) 

i 

© 

eg 



RT 

TR 

AT 





H 

1 

1 

© 

eg 

© 

<7- 

c 

o 

o 

1 

1 

© 

i 

i 

C* 








< 

1 


eg 

eg 

rH 

r^ 



1 

e* 

i 

© 

















1 


i 

rH 







w 


1 








1 


i 








a 

rv' 

1 

eg 

C 

© 

■<7 


© 

o 

1 

© 

\ 

© 







00 

H 

I 


rg 

eg 

r-i 




1 

CO 

t 

© 









1 








I 


i 

i—4 








r* 

1 

1 

■*r 

o 

© 

© 

© 

© 

c 

1 

© 

i 

© 









1 

r— i 

eg 

eo 

eg 

eg 



( 

— 

i 










1 

! 








i 

i 


i 

! 

rg 








H 

f 

1 

V 

© 

© 

O 

C 

o 

© 

1 

» 

© 

1 

1 

© 








< 

1 








I 

rl 

1 

© 







m 


1 








i 


1 








rH 

a 

l 

1 

rg 

© 

© 

© 

o 

o 

o 

( 

1 

HT 

1 

1 

© 

W 







H 

r 

rH 







1 

eg 

I 

© 

w 


r-i 

rH 



w 


i 








t 


I 


< 


• 

• 





i 








t 


} 


w 


rH 

r-i 

© 



H 

i 

*7 

rg 

eg 

eg 

eg 

© 

© 

1 

eg 

1 

eg 

J 

< 

• < < < 

• 

d 

< 


K 

i 

i— 1 


*-H 

r-* 

r-i 



1 

© 

1 

m 

UJ 


m ^ '"h ^ 

m 

n 




i 

t 








1 

\ 


1 

1 

rH 

(X 

2 

©222 

© 

X 

2 



i 

i 

rT 

<7 

■c 



o 

© 

1 

1 

© 

1 

1 

o 








< 

t 

I— i 


r-i 

i— ! 




i 

r- 

t 

© 









i 








l 


l 

rH 







10 


i 








i 


1 








H 

a 

i 

rg 


r 

rr 

<7 

© 

© 

i 

© 

\ 

© 







►H 

H 

i 

rH 

rH 

rH 

i— ( 

H 



i 

© 

\ 

r* 


4J 

4J 






i 








i 


1 

rH 


V) 

V) 






i 








i 


1 



0 

O 





H 

i 

^r 


<■ 



o 

© 

i 

o 

1 

© 

2 H 

H 





K 

i 

H 

rH 

i— 1 

rH 

r-i 



i 

e~ 

1 

© 

O 


JJ 0) 

4J 


4J 



i 








i 


1 

rH 

M 

0 

g; c u w 

W 


LO 



i 








l 


1 


E-i 

u 

u o c c 

QJ 

G) 

G> 



i 








i 


1 


< 

c 

C E rc 0 

H 

e- 

H 



i 

O 

CO 

eg 

rr 

rr 

© 

© 

f 

■c 

i 

TT 

tS3 

<0 

fC c 





< 

i 

rH 

rg 

r~i 

rH 

rH 



i 

© 

i 

rH 

i—i 

4J 

4J 0 GJ Jj 

E 

E 

E 



i 








i 

rH 

i 

eg 

z 

C. a-H 4J rc 

G) 

GJ 

GJ 

00 


i 








i 


i 


< 

0 

0 V c u 

4J 


4J 

CJ 

x 

i 

CO 

© 

eg 

-<r 


© 

© 

i 

TT 

i 

"7 

o 

u 

U > *-> CJ 

tn 

to 

in 

o 

fr- 

j 

H 

rg 

re 

rH 

r-i 



i 

O 

i 

rH 

X 

0 

U G) rc a 

>i>>i 



i 








i 

rH 

[ 

eg 

o 

< 

< a s o 

w 

CQ 

U) 


H 

i 

o 

eg 

co 

© 

© 

© 

o 

1 

eg 

i 

o 








QO 

i 

eg 

m 

n 

eg 

rg 



i 

rr 

i 

r- 









i 

i 








i 

i 

rH 

i 

i 

eg 








H 

i 

i 

rr 

o 

CO 

rf 

«7 

*7 

*7 

i 

i 

© 

i 

i 

o 








< 

i 

eg 

eg 

*7 

eg 

rg 

eg 

eg 

i 

© 

i 

© 









i 








i 

rH 

i 

re 







n 


i 








i 


i 








CL 

css 

f 

<■ 

© 

CO 


■c 

c 


i 

© 

i 

O 







<* 

H 

i 

eg 

rg 

9S- 

eg 

rg 

rg 

eg 

i 

© 

i 

© 









i 








i 

rH 

i 

m 

X 


cs 






\ 








i 


i 


o 


U3 






i 


o 

CO 

© 

© 

•*r 

<7 

i 

© 

i 

rg 

H 







x 

i 

eg 

eg 

*7 

n 

re 

rg 

eg 

I 

o 

i 

© 

LO 








i 








l 

rg 

i 

n 

rj 


2 



u 



* 













u 

< -3 


_3 

U- 


> 

i 

z. 

0> 


3 

• — f 


c 




© 

a 

I— 

to n z c*; 

i— t 

r - 1 

—3 


< 

i 

c 


0 

z 

U 

(Z 

Z 




jj 

U2 

b 

t-: tJ < C. 

< < 

O 



i 

2 

c- 

;> 


a. 

w 

w 




£ 

X 

cc 

-^>o 

c 

0J5 

2 


22 


Figure 5. Example of a Hardware Resource Monitoring Database (HWDB) report for a one week period. 
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o System Engineering - enter/update impact 

assessment information 
enter/update defect 
causal analysis data 
generate DSI counts for 
requirement impact 
assessments 

create software release 
status reports 
enter/update resource 
utilization information 

o Management - review software release status 
review SPR/STR status 
review resource utilization metrics 

Access to the SEDB for any add/edit capability is restricted by user group, 
report form, and data field. This ensures that all information contained within 
the database is protected from unauthorized access. 

The SEDB allows all users to search data by log number, keyword/phrases or other 
significant field. This provides a mechanism for quick access to specific 
information . 

In addition, the SEDB allows reports to be generated based on any combination of 
fields, that is, data may be sorted on these fields. Users can define what 
information is desired for a specific report. 

The operational usage of the SEDB provides significant advantages to the project. 
It is flexible - it allows reports to be quickly created for specific users. The 
SEDB is efficient - it is immediately accessible via the LAN, therefore there is 
no need for paperwork delay. Since all information is from one source with an 
online updating capability, the SEDB is also accurate. All project personnel 
have access to the same information. Finally, since the SEDB is menu driven, 
user training time is minimal and operator confusion is virtually eliminated. 

5.0 FUTURE ACTIVITIES 
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It is anticipated that the SEDB will be utilized on other projects; for example, 
it has been successfully transported and utilized on the X-Band Synthetic 
Apperture Radar (XSAR) project. Although the future plans for the SEDB depend 
upon funding, the following represent some of the potential capabilities that are 
being examined for possible implementation: 

o Display Graphics and Graphical Outputs 
o Personnel Resource Management Database 

o Online Interface Control Documents (ICDs) and Data Format Control 
Documents ) 
o Cost Estimation 

6.0 SUMMARY 

In summary, the SEDB is an excellent tool that provides access to standardized 
and consistent data. It facilitates management by allowing the monitoring all 
tasks within their purview and provides a method to produce task required 
products in a timely, accurate and consistent formats. It can be utilized by the 
entire project and provides a basis for continuous process improvement. 
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